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Abstract. Let i*sc(A k; t) be the Heckman-Opdam hypergeometric function 
of type BC with multiplicities k = (^1,^2,^3) and weighted half sum p(k) of 
positive roots. We prove that Fgc(X + p(k), k\ t) converges for ki + k'2 —¥ 00 
and fci/fe -> 00 to a function of type A for t £ R n and A S C" . This limit is 
obtained from a corresponding result for Jacobi polynomials of type BC, which 
is proven for a slightly more general limit behavior of the multiplicities, using 
an explicit representation of Jacobi polynomials in terms of Jack polynomials. 

Our limits include limit transitions for the spherical functions of non- 
compact Grassmann manifolds over one of the fields F = R, C,H when the 
rank is fixed and the dimension tends to infinity. The limit functions turn out 
to be exactly the spherical functions of the corresponding infinite dimensional 
Grassmann manifold in the sense of Olshanski. 



1. Introduction 

Consider the Heckman-Opdam hypergeometric functions Fr(X, k; t) for the root 
systems R — BC n — {ie^, ±2ei, ±e^ ie^-, 1 < i < j < n) and A n -i = {±(ei — ej) : 
1<2<J<tt,} with multiplicities k = (fci, fe, £3) an d k — k respectively as studied 
e.g. in [BO], [HI], [H2], [HJ], [HS], [01], [02]. Fix a positive subsystem R + in each 
case and denote by pit,{k) = , X^aefl k a a the weighted half-sum of positive roots. 
The Jacobi polynomials of type BC n are indexed by the cone of dominant weights 

P+ = {(Ai,...A„) £%l : Ai >...> A„} 

and can be written as 

F ^ C ( fc; *) = 7YZ 1 —Ha ^ Fbc ^ X + P BC ^> fc; *) 
c(A + PBc(k),k) 

where c is the generalized c- function. The Jacobi polynomials of type A n ^\ are 
indexed by the set tt(P + ), where it denotes the orthogonal projection of W" 1 onto 
Mg . They can be written as monic Jack polynomials, 

i^ (A) («;*)=^(e*) ) icMJ, 1 ; 
see Section 4 for the precise notation. 
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In this paper, we shall prove the following limit transition for the Jacobi poly- 
nomials of type BC n : 

lim P A BC (M) = *M-j£(x(t)) (1.1) 

fel /k'2 — > a 

for a G [0, oo], with the transform 

M"^R ? ;, 1 1-> a:(t) with Xi {t) = 7a + sinh 2 (|), 7o = ±±I. 

This result was already stated in |K2j without proof. A proof different from the 
one in the present paper was given by R. J. Beerends and the second author in an 
unpublished manuscript. 

Restricting to the case a = oowe shall next extend the limit with respect to the 
spectral variable A and prove that 

lim F BC (X + p BC (k),k;t) (1.2) 

fci/fea — > oo 

= n(cosh 2 |) l: - lAl/ ".F A (^(A)+^(fc 3 ),fc3;7r(logcosh^)) 

i=i 

for all t £ R™, locally uniformly in A 6 C™. 

Let us briefly discuss the above limits for the rank one case n = 1 where does 
not appear, the functions Fbc{\ k]t) are essentially Jacobi functions 

^\t) = 2 Fi{\{a + j3 + »A), \{a + p + 1 - *A); a + 1; - sinh 2 1), 

for which we refer to |Klj , and where Fa reduces to the constant function 1 . More 
precisely, comparing the examples on p. 89 of |Q1) and |K1) . we have 



7l (A, k; t) = (\) with a = ki + k 2 - 1/2, /? = k 2 - 1/2, 

and (|1.2I) becomes the limit 

lim ^ (;) = (coshir A (AeC). 

a — > oo , a j p — > oo v 1 M 1 * 

This limit is easily seen from 

<P%$ a+fl+1) (*) = *Fi(h iX > 01 + P + 1 - ¥ X > " + 1; - sinh 2 t) 

= (coshty lX 2 F 1 (\i\-l3 + ±iA;a + l;tanh 2 t). 

Moreover, the Heckman-Opdam polynomials in rank one are related to the monic 
Jacobi polynomials pn*'^ by 

P^ c (k-it) = 2>^ ) (cosi), n e Z+. 

Limit (|1.1|) means that for c = a + 1 6 [1, oo) and x = cost 6 [—1, 1], 



lim pi 

a— >oo,(x/0 



This limit is easily seen from 

( a)j 8) / \ 2" (a + 1)„ (n + a + /3 + 1) ; (n\ (x-1 

Pn ' {X '~ (n + a + /3 + l)„ 2-, („ + !), 
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We shall obtain (jl.ljl by means of an explicit representation of P^ c in terms 
of Jack polynomials which goes back to ideas of |SK] and to |Haj . The limit (|1.2p 
for the hypergeometric function is then obtained from by Phragmen-Lindelof 
principles and sharp explicit estimates for general hypergeometric functions which 
slightly improve estimates by Opdam [01] and Schapira Sch . Our limit transi- 
tion (|1.2j) includes a limit result for the spherical functions of the Grassmannians 



SO (p,n)/SO{p) x SO(n), SU{p,n)/S(U(p) x U(n)) and Sp{p,n)/Sp(p) x Sp(n), 



where Sp(p, n) denotes the pseudo-unitary group of index (p, n) over H. As p — > oo 
(and the rank n is fixed), the spherical functions of these Grassmannians con- 
verge to (restrictions of) the spherical functions of the reductive symmetric space 
GL + (n,R)/SO{n),GL(n,C)/U(n) and GL(n, M)/Sp(n), respectively. We shall 
also show that the obtained limits are exactly the spherical functions of the corre- 
sponding infinite dimensional Grassmannians in the sense of Olshanski. Our results 
for infinite dimensional Grassmannians are also of interest in comparison with the 
recent results of [DOW . There it is shown that under natural conditions on an 
infinite dimensional symmetric space Goo/Koo = lim G n /K n where G n /K n are 

Riemannian symmetric of compact type, spherical functions of G n /K n can have a 
limit which is i^oo-spherical only if the G n /K n are Grassmannians. 

This paper is organized as follows: In Section 2 we recapitulate some basic 
notions and facts on the Cherednik kernel and Heckman-Opdam hypergeometric 
functions. We need the Cherednik kernel because we improve in Section 3 estimates 
of Opdam |01J and Schapira |Sch] for this function. This results in an estimate for 
the Heckman-Opdam hypergeometric functions which is uniform in the multiplicity 
parameters. The Cherednik kernel will not be further used in the main part of the 
paper, starting in Section 4, where the limit (jl.ip for Jacobi polynomials of type BC 
is proved. This result, the estimates of Section 3, and Phragmen-Lindelof principles 
are combined in Section 5, leading to the limit (|1.2[) . In Section 6 we briefly discuss 
this limit in terms of spherical functions for non-compact Grassmann manifolds of 
growing dimension and fixed rank. Finally, in Section 7 the Olshanski spherical 
functions of the associated infinite dimensional Grassmannians are characterized. 



Let a be a finite-dimensional Euclidean space with inner product ( . , . } which is 
extended to a complex bilinear form on the complexification ac of a. We identify 
a with its dual space a* = Hom(a,R) via the given inner product. Let R C a be 
a (not necessarily reduced) crystallographic root system and let W be the Weyl 
group of R. For ctGfl we write a = 2a/ (a, a) and denote by u a {t) = t — (t, a v )a 
the orthogonal reflection in the hyperplane perpendicular to a. We denote by JC 
the vector space of multiplicity functions k — (fc Q ) Qe _R, satisfying k a = kp if a and 
j3 are in the same M^-orbit. We shall write k > {k > 0) if k a > (k a > 0) for all 
a e R. For k G K let 



be the weighted half-sum of positive roots, where i?+ is some fixed positive subsys- 
tem of R. Let 



2. Notation and Preliminaries 




(2.1) 



o+ := {t E a : (t, a) > Va e i?+} 
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be the positive Weyl chamber associated with If k > 0, then p(k) G a+. and 
if k > 0, then p{k) G a+ . This follows from the fact that for a simple system 
C R+ (with indivisible roots the reflection o~ ai leaves i?+ \ {on} invariant, 
and hence 

(p{k), a() = fc Ql + 2k 2ai 
(with the understanding that k 2ai — if 2a,; £ R), c.f. [M], Section 11. 
For fixed k G /C, the Cherednik operator in direction £ G o is defined by 

T e = T e (fc):=a e + X! Ma,073^(i-^)-(p(fcU> 

QG-R+ 

where is the usual directional derivative and 

e x (t) := e< A ^ VA,iGa c . 

For fixed fc, the operators {T^(fc), (6 a) commute. According to Theorem 3.15 of 
[Olj . there exist a W- invariant tubular neighborhood U of a in ac and a unique 
holomorphic function G on ac x K res x U which satisfies 

(i) V£ e a, A e a c : T f (fc)G(A, fc; . ) = (A, £>G(A, fc; . ); 

(ii) G(A,fc;0) = l. (2.2) 

The function G is called the Cherednik-Opdam kernel. We shall mainly be con- 
cerned with the hypergeometric function associated with R, which is given by 

F(X,k;t) :=-L G(X,k;w-H). 

It is actually W^-invariant both in A and t. The functions -F(A, k; . ) generalize the 
spherical functions of Riemannian symmetric spaces of the non-compact type, which 
occur for specific values of the multiplicity parameter k > 0. 

In order to interpret the main results below in the geometric context, we shall 
use the following scaling property: 

Lemma 2.1. Let R be a root system in a Euclidean space a with multiplicity func- 
tion k. For a constant c > consider the rescaled root system R := cR := {ca, a G 
R} and define k on R by k ca := k a . Then the associated Cherednik kernels are 
related via 

G x (k;t) = G x/C (k;ct). 
A corresponding result holds also for the associated hypergeometric functions. 

Proof. Write f(t) = f(ct) for functions / on a. Then 

(T ( (k)f)(t) = (T ci (k)f)(ct). 
In view of characterization (12.21) , this implies the assertion. □ 

In this paper, we shall always assume that k > and we often write 
G(A, fc; t) = G A (fc; t), F(X, k; t) = F A (fc; t). 

For certain spectral variables A, the hypergeometric functions F\ are actually 
exponential polynomials, called Heckman-Opdam Jacobi polynomials. To introduce 
these, let P = {A G a : (A,a v ) G Z Va G R} denote the weight lattice of R and 
P + = {A G P : (A, a v ) > OVa e R + } the set of dominant weights associated 
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with R+. We equip P+ with the usual dominance order, that is, fi < A iff A — jJL is 
a sum of positive roots. Let 

T := span c {e\ X e P} 

denote the space of exponential polynomials associated with R. The monomial 
symmetric functions 

M\ = e "' XeP + ( 2 - 3 ) 

iiewx 

form a basis of the subspace T w of W^-invariant elements from T. 

The Jacobi polynomials {P\(k), A 6 P+} associated with R are uniquely char- 
acterized by the following two conditions: 

(i) P x (k) =M X + J2 CAp(fc)M P (ca^J;) e C); 

(ii) L fc P A (fc) = (A,A + 2 j0 (fc))P A (fc) 
with the operator 

L k = A a + J2 fc « coth^ d a . (2.4) 

This is just the W^-invariant part of the Heckman-Opdam Laplacian, which is given 
by restriction to PT-invariant functions of 

n 

1=1 

with an arbitrary orthonormal basis {£i, . . . , £„} of o. The operator generalizes 
the radial part of the Laplace-Beltrami operator on a Riemannian symmetric space 
of the non-compact type. 

Let us point out that in the definition of the Jacobi polynomials, condition (ii) is 
frequently replaced by an orthogonality condition. As remarked in Proposition 8.1 
of [HI] , both sets of conditions are equivalent. Note also that in |Hlj . the Jacobi 
polynomials are indexed by —P+ instead of P + . which leads to a different sign in 
(ii). 

According to equation (4.4.10) of [HSj . the P\(k) can be expressed in terms of 
the hypergeometric function via 

F x+p (k; t) = c(A + p, k)P x (k; t), (2.5) 

where c(X,k) is the generalized c-function as defined in |HSj . Definition 3.4.2. As 
the polynomial Po(k) is a constant, it follows that 

F p (k;t) = l. (2.6) 

3. Some estimates for G and F 

The growth behavior and asymptotic properties of the Cherednik kernel G and 
the hypergeometric function F have been studied in detail in |01j as well as in 
}Schj . where the precise asymptotic behavior in the space variable was determined. 
We recall the following results: 

Lemma 3.1. f [Qlj ) Let k > 0. Then for all A 6 etc an d a ^ t € ft, 

\G X {k;t)\ < y/\W\ . e ™*u,ewRe{w\,t) _ ( 31 ) 
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Lemma 3.2. flSch] ) Let k > 0. Then 

(1) For A G a, the kernel G\{k] . ) is real and strictly positive on a. 

(2) \G\(k;t)\ < G Re \(k;t) for all A G a c and t G a. 

By symmetrization over the Weyl group, one obtains the same properties and 
estimates for the hypergeometric function F. 

In [Sch , Opdam's estimate (|3.1|) was substantially improved. In fact, it is shown 
there that for all A G a and all tea, 

G A (fc; t) < G (k; t) ■ e ">««ew<i«A,t> (3.2) 

and that for fixed k > 0, the kernel Go has the asymptotic behavior 

G (k;t) X [] {l + (a,t))e-^ 
ueii a + \{u,t)>o 

where denotes the set of indivisible positive roots and t+ is the unique element 
from the orbit Wt which is contained in a+. 

The following result generalizes Schapira's estimate (|3.2p . 

Theorem 3.3. Let k > 0. Then for all A G a, all /1 G 0+ and all t G a, 

GWM) < G„(M) • e max ^-^. 
T/ie same estimate holds for the hypergeometric function F instead of G. 

For /1 = p 6 a+ we obtain, in view of identity (|2.6|) and of Lemma 13.21 the 
following 

Corollary 3.4. Let k > 0. T/ien /or a^/ A G ac and all tea, 

\F X+p {k;t)\ < e max roew Rc(»A,t)^ ^33^ 

Remarks. 

(1) While the proof of p.2[) is by real- analytic methods and uses the Cherednik 
operators, we shall present a different approach, based on methods from 
complex analysis. 

(2) Remark 3.1 of Sch implies the following asymptotics for t G o+, when 
k > and some real A G a+ are fixed: 

F x+p (k;t) x e< A >'>. 

For our purposes, it will however be important to have an estimate which 
is uniform in k. 

For the proof of Theorem l3.31 we shall use the Phragmen-Lindelof principle, see 
e.g. Theorem 5.61 of [T] : 

Lemma 3.5. (Phragmen-Lindelof) . Let f be holomorphic in an open neighborhood 
of the right half plane H = {z G C : Rez > 0}, and suppose that f satisfies 

\f(iy)\<M VyGM 

and, as \z\ = r — > 00, 

f(z)=0(e r ') 

for some j3 < 1, uniformly in H. Then actually \f(z)\ < M for all z G H. 
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Proof of Theorem \3.3\ Fix i G a and denote again by i+ the unique element from 
the orbit Wt which is contained in a+. Further, put 

S := {A £ a c : Rc A G a+}. 

The geometry of root systems implies that for A G S and all w G W, 

(wReX,t) < (ReX,t + ). 

Fix now w G W and consider the function 



/(A) 



_ -(A,t+) GwX+njk-jt) 

G,(k;t) 



which is holomorphic on ac- We shall investigate / on the closure S of S. By part 
(2) of Lemma l3~2l we have 

|/(A)| </(ReA). 

Hence for A 6 S, Lemma l3~Tl leads to the estimate 

(3.4) 



Note that the right side is independent of A. Again by Lemma l3"T2l we further obtain 
for real A £ a the uniform estimate 

l/(<A)l = lG ™ X y {k > t)l < I. (3.5) 

We claim that |/| < 1 on S. For this, fix a basis {Ai, . . . , A„} C P + of fundamental 
weights. Then each A G S has a unique expansion A = ^27=1 w hh z% G H = 
{z G C : Re z > 0}. Consider first A = ziAi with z\ G H. In view of estimates (I3.5[) 
and (|3.4p . we may apply Lemma 13.51 with j3 = 0, thus obtaining 

|/(ziAi)|<l V^iGiT. 

We proceed by induction: Suppose, for 1 < m < n, that 

|/(ziAi + . . . + z m A m )| < 1 Vzi, ...,z m eH. 

Consider h(z m+ i) := /(z 1 A 1 + . . . + z m A m + z m+1 A m+ i) for z m+ i G H. This function 
is uniformly bounded on H according to (|3.4j) . and for purely imaginary z m+ i G iR 
we have 

\h(z m+1 )\ < |/(Re(z 1 A 1 + . . .+z m X m +z m+1 X m+1 )) \ = |/(Rez r Ax+. . .+Rez m -A m ) | 

which is less or equal to 1 by our induction hypothesis. By Lemma l3.5[ we conclude 
that \h(z)\ < 1 for all z G H. Thus, induction shows that |/(A)| < 1 for all A G S, 
and in particular for all A G o+. If A G a is arbitrary, just use the fact that A = wX' 
with some w G W and A' G a+. This implies the assertion. 

□ 
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4. Limit transition for Jacobi polynomials of type BC 

Let a = R™ with the usual Euclidian scalar product and denote by (ei)i=i,... )n 
the standard basis of R™ . We consider the root system BC n in R™ with the positive 
subsystem 

BC+ = {e l; 2a, 1 <i < n}U {ei±ej, 1 < i < j < n}, 

as well as the root system A„_i in the linear subspace 

R£ := {t € R n : *i + . . . + t n = 0} 

with the positive subsystem 

A+_ x = {e, - ej, 1 < i < j < n}. 

The Jacobi polynomials associated with these root systems as well as their rela- 
tionship have been widely studied; see in particular jBOj . |BFj . [HI] and |H2j . We 
recall the fundamental facts: Let 

7r(i) :=t- ~{t,uj n )uj n (4.1) 
n 

with 

u} n = ei + ... + e„ 

denote the orthogonal projection of R™ onto Rq . The cone of dominant weights of 
BC n is 

Pf c = {(Ai, . . . A„) e Zl : Ai > . . . > A„}, 
and the dominant weights of A n -\ are given by 

For abbreviation, we write P + := P+ c , which is just the set of partitions of length 
n. The dominance order on P + is given by 

i i 

A < fj, < i = l,...,n. 

i=i J=l 

For the j4„_i-case, we take a real parameter k > and consider the monic Jack 
polynomials in n, variables which are indexed by partitions A € P+ and are 
uniquely characterized by the following conditions: 

(1) j£ is homogeneous of degree |A| and of the form 

where /i < A refers to the dominance order on P + and the m\, A <E P+, are 
the monomial symmetric polynomials 

m x ( x ) = ^ (xe R"). 



(2) j% is an eigenfunction of the operator 



dx^ x^ x -j dx 
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In fact, the Jack polynomials satisfy 

n 

DJx = d x (K)j% with d x {n) = ^ A,(Ai - 1 + 2n(n - i)), 

i=l 

see |Haj or [5t]. For k = 0, we have J? = m>, while for k > 0, the polynomial 
j^(x) coincides up to constant positive factor with the Jack polynomial J\(x\l/ n) 
in standard normalization as introduced in |Stj . 

The Heckman-Opdam Jacobi polynomials of type A n _i with multiplicity param- 
eter k > are essentially Jack polynomials; according to Proposition 3.3. of BOJ, 
they are given by 

P/ (A) (K;t)= j£(e*) where e t = (e tl ,...,e 4 "), t = (h, . . . , t n ) e R£ . 

Notice that the homogeneity of the Jack polynomials implies that for arbitrary 
t G R™, 

j«(e* ) = e W(*i+~+*»)/» . j«( e *(*)). (4.2) 

The Heckman-Opdam Jacobi polynomials of type BC n are parameterized by a 
multiplicity function k — (k±, k%, k^) > on BC n , where k\ stands for the parameter 
on e,, &2 for the parameter on 2e^ and k% for the parameter on ei ± ej. Let L^ c be 
the associated operator (|2.4p of type BC n . The corresponing eigenvalue (see [Ha] ) 
is 

e x (k) :=dx(k 3 ) + (h+2k2 + l)\X\, 
with d\ as above. We then obtain from |Ha) the following representation of the 
BC„-type Jacobi polynomials P x BC (k) in terms of the Jack polynomials j^ 3 : 

Proposition 4.1. For all X, k,t as above, 

^**)-^n^^i#(--^(5))- («> 

fid A 

flere sinh 2 (— ) zs understood component-wise, and fi C A means that ^ / A and 
A*i Aj /or eac/i i. 

Proof. Denote the right hand side of (|4.3|) by P^ c (k\t). It follows from relation 
(13) of |Haj that P x BC (k; t) is equal to P x BC (k; t) up to a multiplicative constant. In 
order to identify this constant, we compare the leading terms of both polynomials 
in the expansion with respect to the monomial symmetric functions M^ c of type 
BC as defined in (|2.3[) . In fact, 

^\m x {sir^ t -)=M^{t)+Y J dx,M^{t) 

with certain constants dx^ (c.f. [SK , p. 383). Taking the characterization of the 
Jack polynomials as well as part 1 of the characterization of the P x BC (k;t) and 
the definition of ti on p. 1580 of |Haj into account, we conclude that 

Pf c (k;t) = A/f c (t) + ^M* c {t) (4.4) 
with certain coefficients ex^- Therefore P x BC (k;t) — P x BC (k;t) as claimed. □ 
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Wc notice that representations such as (|4.3|) were already observed by Macdon- 
ald [M] and were used in }SK] for limit transitions between different families of 
orthogonal polynomials. 



From (|4.3|) . we shall deduce the following limit result which was already stated 
as Theorem 1 in [K2| without proof. 

Theorem 4.2. Fix a parameter < a < oo and consider k = {ki,ki,ks) where 
ks > is fixed. Then 

Jim Pf c (fc;i) = ^-j^(x{t)), (4.5) 

fei jk-2 — > a 

where the transform 1 1-> ai(i),R™ — > R" is given by 
Xi{i) =j a +sinh 2 (^-), 7a = 

with the understanding that 7oo — 1. The convergence in (|4.5I) is locally uniform in 
t G R™. Especially if a = 00, £/ien 

lim Pf c (fc;i) =4l A ljt(cosh 2 ^) 

fci/fea — ^ oc 

= (n4cosh 2 |) |A|/,l .p4 A) (fc 3 ; 7 r(logcosh^)) (4.6) 

i=l 

The case a = 00 occurs for instance if fe, fc 3 > are hxed and k\ — > 00. 

Proof. Wc split the coordinate transform t x{t) and consider first the transform 

Di = -sinh — 



which is frequently used in the £?C-setting. In y-coordinates, the operator L^ c 
becomes 



n 0^ n 1 5 

Z f C = ^t^(y l -l) 7 TT-^(fci+fc 2 +^-(fci+2fc 2 +l)y i )— + 2fc 3 ^ 



ViiVi - 1) g 

dyf j-^ 2 > dyi j£ y l -y J % 

see Section 4 of [BOj (or also [Ha] . Section 2.3). Next, we carry out the linear 
transform Xi = j a — yi, under which L^ c becomes 

11 C = ~ ««)(7. - 1 - + 2fc 3 £ (7a '^ )(7a ' 1 '^ f 



+ ^(fcl + ^2 + ^ - ( fc l + 2fc 2 + l)(7a ~ 
i=l 

Equation (|4.3p thus writes 

Lk C ~ e n(k) , fc 



Pf c (fc;t) =4l*l J] i V"TT^ 3 )(*) (4-7) 



with a; = x(t). As fci + fc 2 — > 00, we have 

e x (k) ~ |A|(fci +2fc 2 ). 
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If in addition ki/kz — > a, then 

fei +k 2 



la ■ 



fci + 2fc 2 

Now let jit C A. Then < |A| and for / e C°°(R") we obtain, as (fci, fc 2 ) -)• oo in 
the required way, 



/( * ) ^iAra(S a!, ^:- |M| ) /(!B) - 



eA(fe) - e^(fc) |A| - |/x| 

For / a symmetric polynomial, the convergence is locally uniform in x £ R™. In 
our case, / = j^ 3 is homogeneous of degree |A|. Thus 



and therefore 



dxi 
2=1 



L k° - e n( k ) -k 3 .fe 3 



e\(k) - e M (fc) 

locally uniformly, for each /i C A. Iteration according to formula (|4.7|) yields 



locally uniformly in t which completes the proof of relation (14.51) . Finally, in the 
setting of relation (|4.6|) we have j a = 1, and the claimed limit result follows from 
formula (|4.2|) . 

□ 

5. Limit transition for hypergeometric functions of type BC 

We now extend the above limit transition to the associated hypergeometric func- 
tions, where we restrict our attention to the case a — oo. 

For abbreviation, we write Cb for the closed Weyl chamber associated with the 
positive system BC£, i.e. 

C B = {t £ R™ : t x > . . . > t n > 0}. 

Observe that under the projection 7r : R™ — > Rq, the chamber Cb is mapped onto 
the closed Weyl chamber associated with the positive subsystem A^_ x of A n _x- 

Again, we consider k = {k\,k-2,k 3 ) where k% > is fixed. We also recapitulate 
that the half-sums (|2.ip of positive roots for BC n and A n _i are given by 

n n 

PBc{k) = *^2(k 1 + 2k 2 + 2k 3 (n-i))e i and pA(h) = h + 1 - 2z)e 4 . (5.1) 

i=l i=l 

Theorem 5.1. For each teR n and A € C'\ 
lim Fb C (A + pBc{k),k;t) 

k\ +/C2 — > oo 
k\/k2 OO 



= n(cosh 2 |) <A ^ >/ ". FA (^(A) + p A (fc 3 ),fc3; 7 r(logcosh 2 i)). 

i=l 

T/ie convergence is locally uniform with respect to A. 
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Notice that in this situation, pBc(k) — > oo. The proof of Theorem 15.11 will be 
based on Theorem 14.21 above and the following well-known theorem of Carlson (see 
e.g. [T], Theorem 5.81): 

Theorem 5.2 (Carlson's Theorem). Let f be a function, which is holomorphic in a 
neighborhood of {z £ C : Re z > 0} and satisfies f(z) = 0(e c ' z ') for some constant 
c < 7T. Suppose that f(n) = for all neffo. Then f is identically zero. 

Proof of Theorem \5.1\ Let K + := {k = (fci, fc 2 , k 3 ) £ R 3 : fc, > Vi} and fix some 
t £ R™. By the £?C-symmetry of both sides, we may assume that t E Cb ■ For 
k G /C+ define 

/ fe (A) := e-^-F BC (X + P Bc(k),k;t) 

and 

5 (A) := e-^ •n(cosh 2 |) <A ' w " >/ ".^( 7 r(A)+ (OA (fc 3 ),fc3^(logcosh^)). 

i=l 

The functions and g are holomorphic on C q . Corollary 13.41 readily implies that 
the family {/& : fc E IC+} is locally bounded on C q and uniformly bounded on the 
set S := {A 6 C g : Re A 6 Cb}; indeed, as t £ Cb we obtain 

|A(A)| < 1 VAeS. (5.2) 

Now let (k(j))j e m C K + be a sequence of multiplicities such that k(j) 3 = k 3 with 
fixed k 3 > and k{j)\ + k(j)2 — > +oo, k(j)i/ k(j)2 — > +oo. For abbreviation, we 
write 

fj ■= fk(j), J 6 N. 

We have to show that fj — >• g locally uniformly on C 9 . By Montel's theorem in 
several complex variables (see for instance [G]), each locally bounded sequence of 
holomorphic functions on C q has a subsequence which converges locally uniformly 
to some limit function which is again holomorphic on C q . It therefore suffices to 
verify the following condition: 

(M) If (fj„) is a subsequence of (fj) such that fj v — > h locally uniformly on 
C q for some h, then ft = j on P. 

Suppose that (fj„) is a subsequence with fj u — > h locally uniformly on C q . 
According to Theorem 14.21 together with (|2.5I) and F\ +p (k;0) = 1, we have 

/i„(A) 5(A) 

for all dominant weights A £ P + . Therefore h(X) = g(X) for all A £ P + . Consider 
again the set S. We claim that 

h(X) = 5 (A) VA £ S. (5.3) 

Once this is shown, the identity theorem will imply that h = j on C, and the 
verification of condition (M) will be accomplished. For the proof of (|5.3|) we shall 
apply Carlson's theorem to g — h on S, which requires suitable growth bounds on 
the involved functions. First, h is the locally uniform limit of the sequence fj v 
which is uniformly bounded on S according to (|5.2p . Hence 

\h(X)\ < 1 VA G S. 
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For an estimate of g on S, note that Re7r(A) is contained in the closed positive 
chamber associated with j4„_ 2 for each A G S. Application of Corollarv l3.4l thcrcforc 
yields 

t. 



e -<-(A),-(lo S (cosh !))> . FA (^(A) +/5A (fc3),fc 3 ; 7r (logCOSh 2 ^)) 



< 1 



for all A G S. Let us call the function on the left E(X) and write 

n , 

\ g (X)\ = | e -(A,*> . e MA),.(iog(co 8 h 2 i))> . JJ( C0S h 2 |) <A ' u " >/n | -i?(A). 

t=l 

As ( 

(7r(x),7r(y)} = (x,y) - -(x,(J n )(y,u) n ) Vie, y G R", 



we obtain 

g(X)\ = | e -(A, f ) . e <A,lo g (cosh^)>| . < JJ( e -ti C0sh 2|) Re ^ 



i=l 

and therefore 

| 5 (A)|<1 VAgS. 

Summing up, we have 

|# - h\ < 2 onS and (g - h)(X) =0 VA G P+. 

As in the proof of Theorem l3.3[ we fix a set of fundamental weights {Ai, . . . , A„} C 
P+ and write A G S as A = X)"=i z ^ with coefficients Zj G {z G C : Rez > 0}. 
Then successive use of Carlson's Theorem with respect to the variables z\. . . . . z n 
shows that actually g — h = on S. 

□ 

6. Limit transition for spherical functions of noncompact 
Grassmann manifolds 

6.1. Spherical functions of non-compact Grassmannians. For specific mul- 
tiplicities, hypergeometric functions of type BC occur as spherical functions of 
non-compact Grassmann manifolds. This was the starting point for the construc- 
tion of hypergroup convolution algebras with hypergeometric functions as charac- 
ters in [R]. Let us recall this connection. For each of the fields F — R, C,H we 
consider the Grassmann manifolds Q p q (¥) = G/K where G is one of the groups 
SO(j{p,q), SU{p,q) or Sp(p,q) with maximal compact subgroup K = SO{p) x 
SO(q), S(U(p) x U(qj) or Sp(p) x Sp(q), where we assume that p > q. We regard 
G and K as subgroups of the indefinite unitary group U (p, q; F) over F. The Lie 
algebra g of G has the Cartan decomposition g = I ® p where t is the Lie algebra 
of K and p consists of the (p + g)-block matrices 

X\ 

x t Q ), X€M M (¥). 
As a maximal abelian subspace of p we choose 

a=jtf t =( 0pxp 0(p_", )X9 j , t e R* 

where t :— diag(ii, . . . , t q ) is the q x q diagonal matrix corresponding to t. 
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The restricted root system A = A(g, a) is of type BC q with the understanding 
that zero is allowed as a multiplicity on the long roots. We identify a* with o via 
the Killing form and o with R 9 via the mapping H t i-> t. Under this identification, 
the Killing form corresponds to a constant multiple of the Euclidean scalar product 
on W, and 

A = BC q = {±e u ±2e u ±e, ±e h 1 < i < j < q} £ R q . 
The geometric multiplicities of the roots are given by 

{d(p — q) for a = ±e< 
d — 1 for a = ±2ej 
d for a — ±e< ± Cj . 

where d = diniRF. We consider the spherical functions of G/K as functions on 
A = exp o. Let Fbc denote the hypergeometric function associated with R = BC q 
and multiplicity k a = \m a (m a as above), and denote by Fbc the hypergeometric 
function associated with the rescaled root system R = 2BC q and multiplicity ki a = 
k a . Then according to Remark 2.3 of |H3j and Lemma [23] the spherical functions 
of the Grassmannian G p , q (W) are given by 

<P\(<k) = F BC (X,k;t) = F BC (X/2,k;2t), A e C q , (6.1) 

where 

(cosht sinhA 
In 1. 

sinhi cosh t J 

The limit k\ —¥ oo in Theorem 15.11 here corresponds to p — > oo. In order to identify 
the limit in this case, we recapitulate some facts on spherical functions of type A. 

6.2. Spherical functions of type A. Consider the symmetric spaces G/K where 
G is one of the connected reductive groups GL + (q,M), GL(q,C), GL(q,M) with 
maximal compact subgroup K = SO(q), U(q) and Sp(q), respectively. We have 
the Cartan decomposition G = KAK with 

A = cxpa, a = {< = diag(ti, . . . ,t q ), t = (ti, . . . ,t q ) £ M. q }. (6.2) 

For the moment, we consider the spherical functions of G/K as functions on o, 
where we identify a = W 1 via t i-)- t. The spherical functions of G/K are then 
characterized as the continuous functions on R 9 which are symmetric and satisfy 
the product formula 

mHs)= [ ^(log{a sing {e^ke^))dk; (6.3) 

JK 

here <J S ing(M) — . . . , a q ) £ M. q denotes the singular values of M £ M q (¥) 
ordered by size: o\ > . . . > a q . The spherical functions of G/K = GL(q,¥)/U(q,¥) 
are closely related to those of G\/K\ where G\ is the corresponding semisimple 
group SL(q,¥) and K\ = SU(q,¥). Indeed, consider the orthogonal projection 
7r : M. q — > Rq as in (|4.1|) . In the same way as above, the spherical functions of 
G\/K\ may be characterized as the symmetric functions ip on Rq which satisfy the 
same product formula (|6.3p . Now suppose that ip is a spherical function of G/K. 
Then for t £ W, we have 

4>(t) = ${t - n(t) + n(t)) = V(f - 7r(t)) ■ ^(n(t)) 
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because t — 7r(t) corresponds to the scalar matrix exp (X^iLi ti/o) 'Iq which belongs 
to the subgroup Zr := {a • I q : a > 0} of the center of G. As the restriction of ip 
to is multiplicative on we have ip(a ■ I q ) = a m with some exponent m G C. 
Therefore 

8 

i/>(t) = exp(m • £ U/q) ■ ^{n(t)) (6.4) 
i=i 

where the restriction tpW^ corresponds to a spherical function of G\ / K\ . Conversely, 
it is easily checked that for a given spherical function ip of G\/K\, formula f|6.4[) 
defines an extension to a spherical function ip of G/K. 

We now return to the usual convention and consider spherical functions as func- 
tions on the group. For G\/Kx, the geometric multiplicity on the restricted root 
system A = A q -i is given by m = d. Therefore, again according to Remark 2.3 of 
|H3j and Lemma \2.1l the spherical functions of G\jK\ can be identified as 

ipx(e l ) = F A (X/2,d/2;2t), teR q , (6.5) 
with A g C q := {A g C q : £? = i X < = 1- For A e C? > P ut m = Ei=i A * • Thcn 

(t--K{t),\)=m-^t i /q. (6.6) 

i=l 

This shows that we can parameterize the spherical functions of G/K according to 

= e^-'W'^ -F A (n(X/2),d/2;w(2t)), A g C«. (6.7) 

With the notions of (|6.ip and (16.7[) . Theorem 15.11 now implies the following limit 
relation. 

Corollary 6.1. The spherical functions ip\ of the Grassmannian Q p 9 (F) and ip\ 
ofGL(q,¥)/U(q,¥) satisfy 

lim (P\+ P ^°(a t ) =tpx+p g /°(cosht) 

p— too ' HO r A 

for all A 6 P and ieR', mi/i f/ie "geometric" constants p g ^° = 2pn(k) given by 

9 9 

^ = ^(d(p + g + 2-2*)-2)ei and p^ = d (l + 1 - 2i ) e >- 

i=l i=l 

Proof. From relation (|6.ip , Theorem 15.11 and identity (|6.6I) we obtain 
lim ¥>a+ p s " (at) = lim F B c(A/2 + p gc (k),k;2t) 

9 

= [](cosh 2 < s: ) <A ^ >/29 -F A (n(X/2) +p A (k 3 ),d/2;TT(\ncosh 2 t)) 

i=l 

= e (UcoshH-n(Uoo S hH),X/2) . ^ ^(a/2) + p A (k 3 ), d/2; vr (In cosh 2 t) ) , 

with fc = (d(p - g)/2, (d - l)/2,d/2). Using pA(fo) g «o and (|6?f|) . we conclude 
that this limit equals 

gOncosh^-^incosh 2 *), A/2+p A (fc 3 )) . F A (ir(X/2 + p A (k 3 )), d/2; 7T (in cosh 2 t) ) 

= -0A+ P y°(coshi ) 

as claimed. □ 
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We finally mention that Corollary 16 . 1 1 can be also obtained with sharp estimates 
for the order of convergence by comparing explicit versions of the Harish-Chandra 
integral representations of the involved spherical functions; see |RV2j . We also 
remark that our limit transition for hypergeometric functions has a counterpart 
in the Euclidean case, namely the convergence of (suitably scaled) Dunkl-Bessel 
functions of type B to such of type A, which was obtained in |RVlj by completely 
different methods. 

7. Spherical functions of infinite-dimensional Grassmannians 

We now discuss an interpretation of the preceding limit results in the context 
of infinite dimensional symmetric spaces and Olshanski spherical pairs. For the 
general background on this subject we refer to Faraut [P] and Olshanski [Oil) . 
[Oil] . In order to be in agreement with standard terminology, we slightly change 
our notation. We consider the Grassmann manifolds G n / K n with G n = SOq(ji + 
q, q), SU(n + q, q) or Sp(n + q, q) and maximal compact subgroup K n — SO(n + q) x 
50(g), S(U(n+q)xU(q)) or Sp(n+q)x Sp(q). In all three cases, G n is regarded as a 
closed subgroup of G n +i with K n = G n C\K n+ i. Consider the inductive limits Goo 
I'tr i , G n and := lim^ K n . Then (Goo, i^oo) is an Olshanski spherical pair, and 
Gca/Koo is one of the infinite-dimensional Grassmannians SOq(oo, q)/ SO(oo) x 
SO(q), SU (oo, q) /S(U(oo) x U(q)), Sp(oo, q)/Sp(oo) x Sp(q). A continuous function 
4> : Goo — > C is called an Olshanski spherical function of (Goo,^oo) if <fi is Koo~ 
biinvariant and satisfies the product formula 

cf>(g) ■ cf>(h) — lim / <p(gkh) dk for <?, /iGGoo- 
™^°° Jk„ 

We shall now classify the Olshanski spherical functions of (Goo,^oo) without rep- 
resentation theory. 

For this we use the decomposition G n = K n A+K n 

{/cosh< sinht \ ~| 
" I n 0~\:teC B \ 
ysinht cosh£ I ) 

of representatives of the K n -double cosets in G„, where again 

C B ■■= {t = (h,...,t q ) €K ? : h > t 2 > ... > t q > 0} 

denotes the closed Weyl chamber of type BC. Therefore, independently of ri, we 
identify with the set of diagonal matrices 

D := {cosht := diag(coshti, . . . , cosht g ) : t g Cb}- 

This gives the topological identification G n j / K n ~ ~ D. Notice that the ele- 
ments of D are just the lower right q x q- blocks of the matrices from A+. In the 
same way, 

{/coshi sinhA ~) 
a t °° := " loo ] : t € C B \ ~ D. 
ysinht cosh t J ) 

By definition of the inductive limit topology, a function cj> : Goo C is continuous 
and Koo -biinvariant iff for all n £ N, </>|g„ is continuous and if„-biinvariant. The 
space of all continuous, l^-bimvariant functions on Goo may thus be identified with 
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the space of all continuous functions on D. Using this convention, the Olshanski 
spherical functions of (Goa,Koo) can be characterized as follows: 

Lemma 7.1. A continuous Koo-biinvariant function <f) : Goo — > C is an Olshanski 
spherical function if and only if there is a continuous function (j) : D — > C with 
4>{c£j°) = 0(coshi) for t G Cb such that <j) satisfies the product formula 



0(a) -(j)(b)= cf)(a sing (akb))dk, a,b e D. (7.1) 

JU(q,¥) 

Here the vector o- sing (...) G W 1 is identified with the corresponding diagonal matrix. 

Proof. Let ^ be a continuous JsToo-biinvariant function on Goo- By the preceding 
discussion, <f> is Olshanski spherical if and only if there is a continuous function 
<j> : D — > C with 4>( a t°) = <j>(cosht) for t G Cb such that 4> satisfies 

0(coshi) -^(coshs) = lim / <f>{a™ k a™) dk = lim / ^ k a n s ) dk (7.2) 

for s,( 6 Cb- We shall use Proposition 2.2 of [R] to rewrite the integrals on the 
right hand side. Let B q := {w G M q (¥) : w*w < 1} and 

A(7 - w*w) {n+q)d,2 -~' dw with 7 := d(q - 1/2) + 1, 

where A denotes the determinant and dw means integration with respect to Lebesgue 
measure. Then 

/ W / ^, m9( sinh^sinh, + cosh, fc cosh,)) 

JK n JB q Ju {q,V) 

• A(J -w*w) {n+ ^ d l 2 -"< dkdw (7.3) 

where Uo(q,¥) is the connected component of U(q,¥). The probability measures 
c" 1 ■ A(I — w*w)( n+q * >d / 2 ~ 1 dw are compactly supported in B q and tend weakly to 
the point measure 5$ for n — > oo. Therefore (|T-2[) is equivalent to 

0(coshi) • </>(coshs) = / 4>(a S ing(cos\it fccoshs)) dk. (7.4) 

JU (q,¥) 

Finally, is easily checked that the group Uo(q,¥) may be replaced by U(q,¥) in the 
integral, which completes the proof. □ 

We consider the reductive symmetric spaces G/K = GL(q,¥)/U(q,¥) of sub- 
section [fTD and resume the notation from there. We introduce the set of diagonal 
matrices 

D := {e L G M g (R) : t = (ti,. . .t q ) G K 9 with h > . . . > t q }. 

Then Gj jK = Dq, and a spherical function ip of G/K may be characterized as a 
continuous function on Dq satisfying the product formula 

tp(a) ■ ip(b) = / ip(o- s i ng (akb))dk, a,b G D . (7.5) 

JU(q.¥) 



Comparison with Lemma 17.11 gives 
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Theorem 7.2. A continuous Kca-biinvariant function <p : Goo — > C is an Olshanski 
spherical function if and only if the function <p : D — > C with 4>(a%°) = 0(coshi) for 
t G Cb is the restriction to T> of a spherical function tp of G/K. Each spherical 
function tp of G/K is uniquely determined by its restriction to D, and the Olshanski 
spherical functions therefore correspond in a bijective way to the spherical functions 
of G/K. 

Proof. The if-part is clear from Lemma I7.ll The converse direction follows from 
Lemma I7.ll together with the following lemma. □ 

Lemma 7.3. Each continuous function tp on D which satisfies product formula 
\7.1\) admits a unique extension to a continuous function tp on Dq satisfying product 
formula J7.5| ). 

Proof. Assume first that tp : Dq — > C is such an extension of ip. Consider first a 
scalar matrix a = rl q with r > 1. Then a G D and hence tp(a) — V?( a )- Moreover, 
as tp{a^ 1 ) — 1/tpia) for a as above, the function tp is uniquely determined by ip on 
the set of scalar matrices Z = {rl q , r > 0}. Now let a G Dq. We then find r > 
and a matrix b G D such that a — rb. Using Product formula (|7.5|) we obtain 

tp(rl q )tp(b) = [ tP(a smg (rkb)) dk = tp(rb) = tp(a). (7.6) 

JU q (¥) 

Therefore, tp is determined uniquely by (p. 

Conversely, it is easily checked that for given ip, the definition of tp first on Z as 
above and then on Dq via (|7.6j) leads to a well-defined continuous function tp on 
Do which satisfies the product formula. □ 

We notice at this point that our proof of Theorem 17. 21 relies only on the explicit 
product formula (|7.3|) and does not require the results of the preceding sections. 
On the other hand, Corollary 16.11 and Theorem 17.21 imply the following 

Corollary 7.4. All Olshanski spherical functions of the infinite- dimensional Grass- 
mannians Goa/K^ appear as limits of the spherical functions of the Grassmannians 
G n /K n . 

Let us finally remark that the arguments above may also be applied to further 
Olshanski spherical pairs with fixed rank, for example to pairs related to the Cartan 
motion groups of Grassmann manifolds with growing dimension. 
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